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ABSTRACT . . 

This report briefly reviews research on teacher 

effectiveness and presents the conclusions of a 2-day conference held 
in October 1969 to consider issues related to the assessment of 
teacher effectiveness and make recoramendatxons to the U.S. OJffce or 
Education (USOE) regarding the encouragement of research xn this 
area. The committee concluded that USOE should encourage and support 
a large-^scale systematic approach to research on teacher 
effectiveness, inoiuding the developnent and testing of measurement 
instruments which allow for cultural diversxty and varyxng crxterxa. 
These instruments would be used in descriptive research to xdentify 
teacher and student characteristics and behaviors and longxtudxnal 
experimental research which would assess f? 

relationships that may be inferred to result from xdentxfxabie 
teacher education experiences. (The report includes an 89-xtem 
bibliography. ) (RT) 
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INTRODUCTION 



This report represents an effort to present some general points 
of view regarding the status of research on teacher effectiveness and 
make recommendations to the U. S. Office of Education regarding the 
encouragement of research in this area. 

Consideration of the extensive investigation of teacher 
competency leads to the conclusions that many facets of the area nave 
been given attention by researchers. Approaches employed have been 
diverse and the findings capable of little generalizability . 
Considerations of methodological problems and conduct of unified, 
systematic studies have been few. And although anumber of poten- 
tiallv important clues are available, differences in points of view 
relative to instructional processes, guiding philosophies of teacher 
education, and methodology, together with the difficulties involved 
in obtaining large scale cooperation and replication, ave 
in a state of confusion about teacher effectiveness and, indeed, a 
state of distrust. The opinion held by many educators, therefore, is 
that teacher evaluation, or the assessment of teacher effectiveness, 
is "intangible" and incapable of empirical study and/or attainment 

in practice. 

To the contrary, the committee reports that although the 
difficulties are real, teacher effectiveness is capable of assessment. 

It is the opinion of, the committee that procedures can be 
applied to estimate teacher effectiveness or dimensions of teacher 
effectiveness. And it is the committee's recommendation that the 
U S Office of Education encourage and support research, particular y 
research along lines to be noted in this report, to develop, validate, 
and disseminate instruments and procedures for the assessment of 
teacher effectiveness . 



I, NATURE OF THE REPORT 



A. The chairman of the committee charged with preparing this 
report takes full responsibility for its contents. 

Members of the committee shared generously during a two-day 
meeting ideas and suggestions that were as stimulating as they were 
diverse. They ranged from complete agreement upon the need for 
theox^^-based approaches to teacher effectiveness and the need for 
continued empirical study of many facets of the problem, to views 
that research properly should be based upon the continued study of 
teachers in the roles they currently play in the educating process , 
and an almost diametrically opposed position stating that such study 
(of what teachers do now in manifesting certain dimensions of teacher 
behavior and/or in producing certain pupil skills) is destined to be 
steirile, at least in its contribution to the future, and that teacher 
effectiveness research should instead direct its attention to the 
role of the teacher in an envisioned computerized, completely indi- 
vidualized, media-oriented educational environment — a future when 
the teacher's "motivating, set-providing, and reinforcing” behaviors, 
"presenting/explaining" behaviors, "evaluating” behaviors, "counseling/ 
advising” behaviors, and to a large degree, "planning and organizing" 
behaviors may be reduced to a minimum and new responsibilities are 
taken on as technician, "man-machine" manager of pupil learning. 
(Proponents of the latter view felt research should more properly be 
directed to the experimental study of pupil-machine relationships and 
to the most effective ways the teacher could intervene, complement, 
and control pupil learning in such an educational environment.) The 
contributions of the committee membership, thus, were many. 

The chairman hopes omissions, inadvertently made, are not 
numerous. He regrets any misrepresentaf’'ons of viovpclats '' ^ "y 

be reflected. He does candidly admit i-he present report rep- 

resents his own best summarization of the state of teacher effec- 
tiveness research, taking into account the committee deliberations 
as well as the abundance of literature that has accumulated, some 
preceding and much important work appearing subsequent to the 
committee meeting (e.g. , the critiques of Rosenshine) . 

B. The report which follows is brief. Extensive and often 
competent reviews of theoretical positions relative to teacher 
effectiveness (including the need for theory in guiding such 
reseaz'ch) , of methodology (including the all-important "criterion*' 
problem), and of research, good and poor, are omitted for the most 
part; the literature is replete with references to teacher effec- 
tiveness, teacher characteristics, criteria of teacher competency, 
descriptions of teachers (and "most liked" and "least liked" teacher 
traits) , and suggested means for improving instruction. References 
to some of the major and more recent studies and reviews are listed 
in the appendix devoted to "References." The bibliography is, a 
highly selected one, but a reader will find the references noted. 
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plus those that accompany the individual studies or reviews, include 
most of the important topics relating to teacher effectiveness 
research. Redundance is. avoided in this report by frequent reference 
to the bibliographical appendix. 

C. Essentially the point of view taken by this report is that 
the study of teacher effectiveness is neither an area that already 
has exhai ^ted means of approach norone that is incapable of empir- 
ical investigation. Practical problems are recognized. Differences 
of opinions among educators are recognized regarding the direction 
of and approaches to research on teacher behavior (e.g., study of 
the teacher of the present in his roles of planner, motivator/rein- 
forcer, presenter/explainer, evaluator, and counselor--an interact- 
ing aide and guide tc the pupil;--is contrasted with study of the 
possible teacher of several decades hence, with a major role of 
technician/organizer/adapter of learning environments (including 
computers and other media) to assist pupil learning by introduction 
to appropriate steps of largely mechanized programs that are pre- ^ 
planned to fit varying stages of development reached by pupils; or 
possibly middle-of-the-road type study directed at identifying an 
emphasizing "teacher-dependent" classroom activities as distinct from 
" teacher -independent" activities of the future) . 

Perhaps research in a number of such directions should be 
supported; they well may complement one another. But the opinion 
of the committee definitely embraces the position that teacher effec- 
tiveness is capable of empirical research and that such research be 
encouraged and substantially supported with funding from the U. S. 
Office of Education. 
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II. BACKGROUND AND OBJECTIVES 



In the spring of 1969 a proposal was submitted to the U. S. 

Office of Education for the conduct of a small group two-day con- 
ference to consider issues germane to the assessment and evaluation 
of teacher effectiveness. 

It was proposed that the participants be researchers and 
scholars in pertinent areas and that the broad objectives of the 
conference would be to (1) consider critical issues in the identi- 
fication, validation, and practicality of techniques of assessing 
teacher effectiveness, and (2) if a major effort appeared feasible, 
formulate recommendations for relevant research, including instru- 
mentation, that might be disseminated for use. by .teacher educators 
and by public schools. 

It was proposed that the initiator would serve as coordinator of 
the conference and that a small group of selected educators would 
review the feasibility of research addressed to salient objectives. 
Prior to the conference, the proposer /coordinator was to send to eac 
of the collaborators a statement delineating some of the major facets 
of the problem. Conferees would be asked to make modifications^ of 
the agenda that seemed desirable, particularly in areas in whicn a 
conferee was be?'.t qualified by virtue of his training and experi-_._cc 
Each collaborator would be requested to prepare a short out me o 
"guidelines" for research and development in the teacher effective- 
ness domain.. The submitted outlines would be distributed to 
participants prior to the conference. 

Following the conference the proposer was to prepare a report 
representing the considerations of the group. Participants were to 
review this report and suggest revisions which might be incorpora e 
in the final report to the Office of Education. I.- a major program 
were to appear feasible to the conferees , it was hoped the report 
might. serve as a basis for subsequent proposals for complementary _ 
studies, collaborative in nature and involving frequent pchange ^ 
information among investigators. Such a report, it was ™ ^ 

nrovide a general design by suggesting major facets of a proble 
toward which research and development in the area of effectivene 
of teachers should be directed. 

Plans were originally made to hold the conference in Chicago on 
May 2 and 3, 1969. Due to commitments of the conferees it became 
necessary to postpone the meeting until eaily Octo er. 

The conferees constituting the "task force" consisted of 
Dr. Lindley J. Stiles, Professor of Education for Interdisciplinary 
Studies, Sociology, and Political Science , Northwestern University , 

Dr. Fred M. Kerlinger, Professor of Educational Research, New York 
University; Dr. Richard L. Turner, Associate Dean for Research, 

Indiana uLversity; Dr. Harold E. Mitzel, Assistant Dean for Research, 
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Pennsylvania S.tate University; Dr. Robert Beezer , Program Director , 

Basic Studies Branch, representing the U. S. Office of Education; 
and Dr. David .G. Ryans, Director, Education Research and Development 
Center, University of Hawaii. David G. Ryans served as chairman and 
coordinator of the group. 

In keepiing with the proposal, the chairman sent to each 
collaborator a tentative statement suggesting possible issues and 
questions in the area of teacher effectiveness research as topics 
that might be considered at the meeting. Some members of the task 
force responded either by submitting additional items prior to the 
meeting or at the time of the conference in Chicago. 

At the conference it was agreed that a report would be prepared 
by the chairman. The report would be transmitted to each member of 
the group and to the U. S. Office of Education, with recommendations 
for subsequent attention by the Office of Education staff regarding 
the sponsorship of a research program to better come to grasp with 
the problems of assessment and evaluation of teacher effectiveness. 

The procedure followed was essentially that suggested in the 
proposal-"with one major exception. Due to the extreme tardiness 
of the chairman in preparing the report (a circumstance contributed 
to, in part, by (a) the chairman’s own participation in an updating 
and continuation of extensive research in the area of teacher char- 
acteristics and (b) the increasing appearance in the literature of 
reviews --par ticularly that of Rosenshine (48) and Rosenshine and 
Furst (55)-'"-and other studies that updated thinking on the topic 
beyond that which prevailed at the time of the committee meeting) the 
chairman has prepared this long overdue report just prior to an overseas 
assignment and has sent it simultaneous ly to the U. S; Office of 
Education and the committee members, neglecting the planned inter " 
mediate step which originally called for a preliminary version subject 
to review and amendment by other committee member s . . For this the 
chairman offers apologies to his. fellow committee. members and urges ^ 
any member who feels so inclined to write an appending statement 
which the U. S. Office of Education may add to the report. 







III. MAJOR THESES 



The major theses of this report are seven: (1) that instruments 

for the assessment of teacher effectiveness can be developed; (2) -that 
such instrumentation necessarily must take into account the diversity 
of expectations of different school systems and communities with 
regard to behaviors or characteristics desired of teachers, i.e., that 
the cross-cultural nature of the problem cannot be ignored; (3) that a 
large scale, integrated, systematic attack need be made on the problem 
rather than further studies representative of the blunderbuss approach 
most frequently observed in the past when (a) a randomly selected 
teacher trait or sample of traits was correlated with some vague, 
contaminated, deficient, and unreliable criterion, or (b) a selected 
and som.etimes operationally defined criterion, e.g., pupil perfomance 
in a subject-matter skill was correlated with some specific sample 
of teacher performance that was hypothesized with doubtful rationale 
to be related to the desired pupil performance; (4) that to avoid 
pitfalls that have deterred teacher effectiveness research in the 
past, (a) careful attention must be given to the identification, 
cataloging, and development of measures reflecting characteristics of 
teachers at any given time or place, (b) the similarities and differ- 
ences among such teacher characteristics in cultures and subcultures, 
i.e,, communities and schools that differ in educational objectives, 
expectations, and value systems espoused, need be researched, Qc) 
"master instruments" that maybe used in all identifiable subcultures 
(instruments that embrace scales which reflect both common character- 
istics and unique characteristics desired in the variety of communi- 
ties included in the master sample of schools and school systems, 
i.e., instruments that will permit a particular school system to ^ 
identify teachers possessing the qualities desired in that community, 
while ignoring qualities that may be desired in other communxties) 
must be compiled; (5) that with such instruments (instruments that 
obviously must be subject to minor modification, or possibly major 
revision, as objectives of schools may change and/or responsibilities 
of teachers may change with introduction of new curricula, teaching 
programs, media, etc.) teacher; education programs could and shoi^a 
take a ’’hard look” at the extent to which the objectives of their 
respective teacher education programs, innovative practices, etc., 
actually selected and/or produced teachers who possessed the charac 
teristics expected from such a teacher education program or practice, 
e g., effects of micro teaching, teaching by discovery, teaching for 
desired personal or social attitudes on the part of Pupils, etc., as 
they are manifested by teacher education graduates; (6) that impor 
tant as it is in teacher effectiveness research and in all research, 
the criterion against which the efficacy of a teacher education ^ 
course or program is ultimately a matter of "reasoned decision of 
those responsible for an educational program; whether such efficacy, 
or teacher effectiveness, be judged from quality of. teacher perfor 
mance per se (i.e., whether the teacher performs in the requirea ^ 
manner under specified circumstances) or from hypothesized produces ^ 
of teacher performance (i.e., pupil change in specified behaviors) is 
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a matter of choice or decision. (A teacher, or a surgeon, may with 
his respective repertoire of responses perform either capably or 
ineptly with similar results--pupils may or may not learn the desired 
responses due to conditions over v;hich the teacher has little control, 
or the surgeon’s patients may respond to surgery favorably or un- 
favorably quite apart from the surgeon’s own skill; quality of 
’’behavior in process” often is a useful criterion in itself. On the 
other hand, few persons would fail to acknowledge that if (a) adequate 
controls over non- teacher or non -surgeon conditions could be main- 
tained and (b) satisfactory estimates of student change (e.g., in 
cognitive or motor . skills , attitudes, adjustment, etc.) and of patient 
improvement or recovery could be effected, and, of course, provided 
there was sufficient replication to permit generalization, the 
’’products” of the teacher or surgeon would weigh heavily in judge- 
ment of his effectiveness or ineffectiveness); (7) that regardless 
of criterion selected, the assessment of teacher effectiveness is 
premised upon an empirical, inductive approach, which looks to (a) 
descriptive research for identifying and measuring dimensions of 
teacher characteristics, including changing characteristics, and for 
identifying/defining, clarifying and measuring dimensions of pupil 
characteristics .that a teacher and teaching program is expected to 
cultivate, and (b) longitudinal experimental research, with adequate 
’’before-after” measures of teacher characteristics and/or pupil char- 
acteristics to assess effects , changes , and relationships that may be 
inferred to result from identifiable teacher education and in-service 
experiences. 



IV. SOME BASIC ISSUES 



In view of the extensive writing about teacher effectiveness by 
educational researchers, philosophers, practicing educators, teacher 
educators and others, this section of the report, like following sec- 
tions, will make slight effort to si^mmarize the extended discussions 
of topics and investigations that have been noted in the literature. 
Instead, attention will be called to some major issues and the reader 
referred to the statements and reviews cited in the accompanying 
bibliography . 

For convenience the major issues faced in teacher effectiveness 
research will be categorized and briefly noted under the following 
rubrics: feasibility of the assessment of teacher effectiveness in 

research and practice; practicality of assessing teacher effective- 
ness; assumptions that are necessary to the assessment of teacher 
effectiveness; theory in the assessment of teacher effectiveness; 
and methodological and procedural problems in assessing teacher 
effectiveness. 

In introducing the consideration of basic issues it seems 
appropriate to comment briefly on attitudes of educators and others 
toward the attainment of teacher effectiveness in teacher education 
and educational practice. 

Most of the adult population recall times when there v/as 
essentially general consensus on the desirability of competent per- 
formance in a personas chosen occupational field, indeed at whatever 
task one undertook. Today it sometimes appears that values have 
changed dramatically and many people are interested less in how 
effectively they can perform and more in how little they can **get by” 
with — accompanied, of course, with maximum materiaT reward. 

Individuals who are sincerely interested in education and 
learning — whether pupils , teacher trainees , teacher educators , school 
personnel, or others — -do not (it is devoutly hoped) subscribe to 
such a viewpoint that minimizes the importance of competency. Not 
that one’s eyes and ears should be closed to its manifestations; it 
cannot be denied that as the fourth quarter of the twentieth century 
is approached, our lives are complicated with myriad paradoxes, often 
it seems, dilemmas. We come face to face with them daily in school, 
in economics, in churches, in government, and in the home. Whether 
we attribute them to the rapid expansion of knowledge, the relative 
affluence of the recent past, effects of wars, developments in 
communication and transportation, release from a sheltered and 
limited acquaintance with mores different from our own, a '’generation 
gap,” or other conditions, they do represent new sets of ideals and 
goals on the part of very vocal and sometimes sizeable groups. 
Whatever the underlying conditions nay be, a deep involvement of 
personal values and apparent changes in values do seem indicated . 
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One set of values we sometimes feel is changing, one that is 
particularly closely tied to our interests as educators, is the sort 
of thing John Gardner alludes to in his book, Excellence; Can We Be 
Equal and Excellent Too ? (18), A brief quotation from Gardner's book 
is pinned to the writer's office wall, a quotation tliat reads: "The 

society which scorns excellence in plumbing because plumbing is a 
humble activity, and tolerates shodiness in philosophy because it is 
an exalted activity, will have neither good plumbing nor good philos- 
ophy, Neither its pipes nor its theories will hold water.” This 
allegorical comment may be quite applicable to many of our concerns 
in education and to the topic of effective teaching. 

The area of work that has consumed a great deal of many 
professional lives has to do with this aspect of exce Hence - - maxima 1 
effectiveness of teaching . Actually, the more immediate goal toward 
which many research efforts, including the writer's, have been 
directed is the description of different kinds of important teacher 
behavior or teacher charcteristics and the determination of condi- 
tions to which they seem to be related. But in such cases the 
ultimate interest obviously (as with teacher education and the 
teaching profession in general) is with effective teacher behaviors. 

It is not entirely clear that all members of the teaching 
profession are equally concerned about teaching effectiveness today. 
Even when some feeble steps are made in the direction of describing 
and identifying teacher behaviors that may be effective, the profes- 
sion may still be faced with the problem of inculcation in teachers 
of the motivation to be ef f ective--to be as excellent teachers as 
they possibly can. 

And we can try to train teachers to be effective and motivate 
them to achieve highly effective performance only to the extent that 
the behaviors that contribute to effective teaching under different 
conditions can be identified. So the matter of '^effective teaching, 
one long discussed , seems likely to remain one of foremost , importance ; 
certainly one that needs much further research and understanding. 

As we attempt to discuss research on teacher effectiveness, we 
are faced with a number of issues and questions that must be consid- 
ered, These are the issues listed at the beginning of this section 
having to do v;ith feasibility, practicality, assumptions we are will- 
ing to male, theoretical models that will guide the research, and 
methodological problems and procedural issues. 

(1) Is it feasible to undertake research on teacher effectiveness 
and to try to assess teacher effectiveness? 

Are the components .of teaching behavior tangible and sufficiently 
describable to permit identification and analysis? 

Are aspects of teacher effectiveness today and in the recent past 
in the same behavioral domain as those that may be required a 
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g6n6r^ition h6nc6? As not6d 6arli6r j sothb ©ducators pr6dict th© 
teacher will become more of a technical manager of the adaptation of 
mechanical aids to student requirements and less of a personal moti- 
vator and reinforcer, presenter and demonstrator, evaluator, and 
counselor/advisor. Should this be an accurate description of teacher 
roles in the future, is it feasible to research those behaviors that 
reflect the teacher’s present functions? 

Furthermore, does the state of current knowledge and knowledge 
that may emerge in the foreseeable future justify attempts at 
evaluating teacher behaviors or judging teacher effectiveness? 

Turning to a second set of issues, (2) is it practical to pursue 
research on teacher effectiveness? 

Even if it is possible to identify certain effective teacher 
behaviors , do adminis tra tive conditions in school practice preclude 
practical application that would permit placement of teachers where 
their competencies V70uld be most useful? 

A further question here--are demands of school systems, and 
communities within systems, so varied that no universal teacher 
education program would rec^lly be practical? Would the prediction 
of school needs and the necessary establishment of many varieties 
of training programs be too costly and demanding for teacher 
education to support? 

Still further regarding practicality, in practice is it really ‘ 
possible to upgrade and reward effective teachers and downgrade or 
eliminate teachers who are clearly ineff ective ^ can results of 
teacher effectiveness research be useful for purposes of supervision 
with teachers who already have attained tenure in a school system? 

Will school systems, for political and other reasons, be averse 
to applying, or slow to apply, procedures that might be developed? 

In connection with practicality we also must always remei^er 
that research yields results which must always be stated and inter- 
preted in terms of ’'probabilities’V--never can the findings be 
accepted with complete assurance; research on teacher effectiveness 
cannot yield infallible guidelines. Will employing schools accept 
this ’’principle of uncertainty" that characterizes all scientific 
endeavor? 

Furthermore, supporters and potential users of research on 
teacher effectiveness must recognize that research efforts, except 
under unusually auspicious circumstances or an occasional stroke of 
serendipity, seldom yield "instant results" that can be quickly 
adapted to practice* Still, further, it must be recognized that re- 
search On teacher effectiveness is likely to yield relatively few 
"universals ," i.e*, common means of assessing behaviors that will be 
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applicable to all teachers regardless of grade level, the values 
espoused by the community in which the teaching is accomplished , 
subject matter content , and the like . (It may be anticipated , 
however, and does seem very probable that ^classes” of teacher 
behaviors may be identified that are agreed to be effective in 
certain ’’classes" of conditions.) 

(3) The matter of assumptions is always an important issue in 
research. The assumptions one is willing to make determines what 
kinds of results he is willing to accept and what kinds of findings 
will not be acceptable. What are some assumptions necessary fcr 
teacher effectiveness research~~and , a very important "issue" type 
question"-are sizh ejbsumptions as must be made acceptable to the 
education prof e ion? 

Some such assumprions involved in teacher effectiveness research 
and teacher effecti” :ness assessment include such as the following: 

(a) Teacher behaviors fall into identifiable "sets" or classes that 
are characterized by some degree of internal consistency and seme 
degree of stability over time and across somewhat differing class- 
room situations. (b) Empirical study and inductive inference provide 
the valid approach to teacher effectiveness research. (c) Teacher 
behaviors can be observed --i.e., dist inguishing features of classes 
of teacher behavior can be noted and can be recorded at some level 
of quantification. The behavioral aggregates that contribute to 
teaching performance are capable of being identified and -described in 
operational terms. (d) Teachers differ among themselves with regard 
to the obs ervab le c las s es of behaviors they exhibit , i.e., teachers 
vary in the degree to which certain characteristics are represented, 
and a teacher who possesses a high level of "task-orientation" may ^ 
possess a quite different level of some characteristic as motivating 
teacher behavior." (e) Teacher behavior is social in nature --rhe 
teacher reacts to and interacts with students . (f) The ultimate goal 

of teacher behavior is the development of specifiable sets of pupil 
behaviors. (g) Teacher behavior is relative to the context in which 
it is performed--what may be effective in one situation may be less 
effective in another. 

Those who are engaged in teacher education assume^ of course, 
that behaviors of students can be shaped or molded by educational and 
classroom experiences —at least, to some extent. (If teacher behavior 
can be materially influenced by teacher education courses arid programs , 
we still need a great deal of information, to be sure, about the more 
appropriate teacher behaviors to educate for, about which teacher 
behaviors are more, and which less, susceptible to modification, and 
about the kinds of educational experiences that maximize the shaping 
of effective teachet behaviors .) 

And I of course , in. dealing with the assumptions made in 
researching and assessing teacher effectiveness, those must be 
considered important issues that have to do with the kind of u.eacher 
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behavior with which we are concerned, i.e., assumptions referre 
earlier which were related to whether the teacher is considered a 

presenter/motivator /planner, or a technician/organizer/adaptor f 

educational media. 

(4) Still another issue the researcher faces is that of the 
theoretical model by which his rese ' will be guiaed. Of course, 
one may have no particular theoretica , ..icdel at all in mind ^ 
sort c/blund.rbuss, or perhtrs 

is tic approach. There is something to oe said f . thi.- " n But 
kind of undertaking. (Darwin employed it t-D gra_t advantage.; 
theoretical models do offer certain incucerrents in ^ 

range of facts, serving a heuristic funini i, ma -ing explicit 
ing gaps in knowledge, and emphasizing syi himati , tath^ f or^'research 
haphlzLd gathering of information. Some urrent 

on^ teachers are outgrowths of role theory, some - social interact^ 
tLorv Lme of linguistic-related theory, and many are varieties of 

behavioral information theory involving r ^ ^ _ 

chanLling and information flow, feedback md reinforcement, decision 
makine etc The theoretical position rnm which one proceeds 

conducting research on teacher ef^ctlveness and 
inLed often underlies other of the ma.ior issues referred to e . 

(5) Still another very large set of issues that affect research 
on teacher effectiveness has to do with method^ to be employed. 
Definition of the dependent variable, i.e. , criterion behav , 
a Stt« usually accorded far too little serious attention in much 
behavioral research. Here we become concerned with distinction 
Vpfween "assessment" and "evaluation," with process and product 
crireria, St^what Rosenshine and Furst (55) 

early collaborator) refer to as "high inference and low i^fere 
type variables, with descriptive, correlational, and antecedent 
conLqSnt typ^s of research (the Present writer, for one feels^^^ 
have a great Lai of work still ahead in satisfactorily describin j. 

Li identifying the important behavioral variables involved in teach- 
ing the determining of how behaviors aggregate and form relevant 
ing, tne aecerminx s distinguishing of relevant from insig- 

rt”i/iSpp^fik“tLS:rri , lith correlational research 

versus controlled experimental research, with the reliability 

^■SSfes of Independent and dependent variables with sampling and 

('hnfh of nonulations of teachers and of classes ot oenavioitp , 
Sth mulLvariate analysis procedures-to mention some of the many 
methodological issues . 

Although only tangentially concerned with "issues,’' comment is 
appropiSt^Lrron refearch dealing with ’’teachers in - 

SLtLn to research dealing with "teachers in 

undertake research on teacher effectiveness we usually elect to 
pursue our study with either one or the other population; 

Lldom both teache.rs-in-tralning and 

are. Of course, inseparable in many respects. But research etrorn 
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usually are directed at one or the other; and, to date, very few 
investigations that have been begun in teacher education have followed 
through with study of the same teachers on-the-job. At least one 
reason for this , it may be presumed, is that some jater degree of 
constancy can be maintained in ’’teacher training research,” permitting 
greater control over measures of the dependent variables and even 
allowing variation in experimental treatment of di ferent groups. In 
school practice^ actual experimentation with adeq :e control over 
experimental., concurrent independent, and dependent variables is 
dif f icult--particularly with variation in the stude its, objectives, 
and expected teacher behaviors in different schools and communities. 
For this reason it may be noted that most of the in-service studies 
(as well, of course, as many of those of teachers -in-training) have 
been correlational in nature., and of the few experimental researches 
that have been undertaken those that appear to be most meaningful have 
been conducted in teacher education institutions, (The writer hastens 
to add that even these have been woefully few.) 



V. 



TEACHER EFFECTIVENESS RESEARCH IN PERSPECTIVE 



An effort has been made to avoid the usual redundancy of reviews 
by providing a fairly complete, albeit short (some ^ ’ 

set of references with this report, accompanied by 

comment. There may be a few conspicuous omissions and some re y 

1 nronseauentlal titles may have been included. But most of the 

j • • e n-T -issues and research on teacher effectiveness, 

important discussions oi issues ana . re.sean.ii 

particularly the relevant reviews of literature, have been in 

The present section attempts very little summarization, 
generalization, or editorializing on the literature discussed. The 
only exception will be brief reference to some of the most rece 
reviews, e.g., the capable critiques of Rosenshine , with a few 
additional comments on current efforts in progress. 

For the reader concerned less with details and largely with the 
general of knowledge, today about teacher f ^ ’ 

fTTTTTTon is directed to (in alphabetical order): Flanders (^2), 

attention is directe \acksop ( 29 ) Mitzel (44), Pi Lambda Theta 

(46), Ryans (56, 57, 60, 61, 63), Stiles and Parker (74), among others. 

Theoretical considerations have received increasing attention; 
fnr £'uch the "deader is referred to: Biddle (2 , 3) , Fattu ( ) , g 

(13 togs and Unruh (16), Gordon = “ ^ ’ ,"^T(66) 

2?), Maiola^36). MacDonald and Lesper h L 

Smith (69), Stolurow (75), Travers (77, 78) j Turner , among 

A special and particularly important problem that perhaps cuts 
across "theory"- and "methodology" is, that of the critgri^,_or 
dependent variable in teacher effectiveness research (^^tually more 
coLectly noted as "criteria" rather than connoting any simple ^ 
"criterion") . A number of references are devoted to ^his^impor 

issue upon which all interpretation of research hinges Me y|^ , 

Am Mitzel (44) Pi Lambda Theta (46) , Rosenshine and Furst > 

Ryks (Sl! 6i) . StLuro« (75) , Turner and FatCu (87 , 88) , among others. 

For manv vears little attention was given the complex 

methodological and procedural problems that incrS^ng’ 

fortunately, this issue is now widely recognized and an 

number of persons are turning to attempts Gage (14) 

by improving the methodology of research: Biddle (2), uage ( ), 

Guzels and Jackson (19) , Hodgson and Horst (25) , Hughes et . ( ) , 

Kerlinger (32), Kounln ,^Jstnn (38). M y ( . _ 

6i;:1hirner(67t:’s2rt“('75)! Soa^ 72) . Wallen and Travers (89) . 

among others. 

A number of the reports appearing in the literature are ^ 

essentiaUy" or in part , sul^r^ and have to do with descriptions 
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of teacher behaviors, teacher characteristics, or aspects £ teacaer- 
pupil interaction. These include, among many, many otheio. Bellack 
(1) , Flanders (8, 9, 11), Gallagher (17) , Getzels and Jac n (19), 
Hiller et al. (24), Hodgson and Horst (25), Kerlinger (30. 31, 32), 
Kerlinger and Pedhazur (33) , Kounin et al. (34) , Mastin (3 ) , Medley 
(39), Medley and Mitzel (42), Rosenshine and Furst (55), P, ans (57, 

58, 59, 61, 62, 63), Schmid et al. (65), Smith et al. (70; Torrance 
and Parent (76) , Travers (77), Travers et al. (79), Turner (80, 81, 

82, 85), Turner and Denriy (86). 

Some of the most searching critical delving into research on 
teacher behavior and teacher effectiveness that has come to the 
writer’s attention has been' the comprehensive reviews of Barak 
Rosenshine (48, 49, 50, 51, 52, 53, 54, -55). 

Rosenshine has made a comprehensive search for recent siudies-- 
both correlational studies of teacher behavior and its association 
with "student products" and controlled experimental research with 
particular, although not exclusive, emphasis upon "low inf -ence'’ 
teacher performance criteria. 

Rosenshine and Furst (55) describe and critique process and 
product studies with regard to five teacher variables that appear to 
have strong support from correlational research of teacher performance 
as related to. student achievement. 

These five variables for which Rosenshine finds strong support 
when measured against student achievement are: clarity ; variability / 

adaptability ; enthusiasm/stimulation ; bus iness -like/task-oriented 
behavior ; and provision of student opportunity to learn . 

Six additional variables are noted which, although lacking in 
strong research support . Rosenshine feels may be worthy of future 
study: use of student ideas/teacher indirectness; use of criticism; 

use of structuring comments; use of multiple levels’ of discourse; . 
probing; and student-perceived difficulty of the course. 

A large number of what appear to be non-significant variables that 
have been researched by various methods also are noted by Rosenshine. 

Rosenshine and Furst (55) also provide a number of .suggestions 
for improved procedures in future process -product , i.e., teacher 
performance compared with student performance research on teaching. 

The criterion problem (stressed • earlier in this report) , of course, 
is emphasized, i.e. , the importance of identifying and describing 
relevant teacher behaviors and relevant criteria of effective teaching. 

Rosenshine suggests a paradigm he believes appropriate for 
experimental study of the effects in teacher education programs^ on 
training teachers to exhibit ' specified classroom behaviors or to 
elicit specified student behaviors ; the paradigm requires that: 
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( 1 ) some teachers be trained to teach partic- 

manner (e.g., emphasis upon n y ’. • „„! etc V (2) observational 

ipation, encouragement of ’ in the training groups 

measures be obtained to veri y pvneriment- and (3) relevant 

really behaved as intended during e P ^ of course, 

e„d-o£-=xperime„t student ^hlch one ^culd build 

a very sketchy summary of the paradigm ulu 

an experimental design. 

In even the "better-designed Education" 

training “j® resulted'’irSasurable improvement in student 

-b!e::Ll:r-ifu:s?!i3 ^«sbred. - --rugse‘r:et:vrroeus:r''^ 

and o" Tar lief r:Lrhs on the need 

on the wrong teacher behaviors - teacher behavior), that we have 

for identifying relevant aggrega e processes that really affect 

not observed the relevant eare and in a system- 
learning, and that "r "^f tS “l^^^nt processes that are 

atic, objective, empirical manner tor 
"critical" as opposed to the trivial. 

Xhe writer wholeheartedly eipL^Sd^ 

experimental research, for the time oe g ) _ . ^he observable 

ffgfegrtefift-^^^^^^^^ sLrfLoLb!e to hypothesise 

may contribute to teacher effectiveness. 

-tually « -her oi distinguishable^classe^ 
feratShfpffo^ f udent -hievement^in^most^ins tances . ^ .et^to seeh 

:fgafis:ri:rifd!f£rr:ffSndrofteac^^^^ 

suLultures is a very important end in Itself . 

in vie» of the Importance of relevant teacher ^^f^viors . a fe™ 

cf the rather »idely "af^^J^arf fefi: ics of f acfef that 

involving behavior styles and other^cha.racteristics 

have emerged to date will be noted brief y. 

considerable evidence !ja= --mulated^sugges^ 

behavior identified by tne le rf^c;nrmsible , business- 

some 20 years ago ^/^ehLior Rosenshine refers to as 

like" teacher behavior, ('Tncid‘=‘ntally Rosenshine 

"task-oriented/business-like e a i ’ “ strongly related 

. .j ^ ^h^c; behavior seemed to oe 

^ find evidence that beh ^ factors emerging from 

to student achievement .) _ Another ot . / ^j-ich several other 

the Teacher Characteristics Study (a^p stimulating imaginative" 

studies support) was "achievement -motrvatrug .^strmu^^^^^^ 

teacher behavior--which Rosens in related to student achievement, 

behavior. This, too, Rosenshine finds related to stu 
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Still another of the major factors indicated, by the Teacher 
Characteristics Study, had to do with "considerate, unuerstanuxus , 
warm, supportive" teacher behavior. (Rosenshine s reviews do , 

reveal much evidence of this kind of behavior actually being related 
to currontly tnoasured studont outcomos.) 

still another factor the Teacher Characteristics Study results 
suggested, but which was not pursued to any great extent seemed to be 
associated with "expressive, attractive, clear, personally and ac d 
ically impressive" teacher behavior; a number of studies seem 
support the existence of such a pattern. 

And another facet of teacher behavior that has received 
considerable attention is the dimension referred to in the Teacher 
Characteristics Study as "traditional, teacher-centered, academic 
viewpoints" versus "permissive, child -centered viewpoints. Kerlinger 
no 31 321 and Kerlinger and Pedhazur (33) have studied such 

attitudinal responses of teachers in depth and find three factors , the 
two more prominent of which are (a) one that seems to reflect^ 

"progress ivism" and which Kerlinger says "seems related to Ryans Xq 
teacher behavior pattern" (the warm, 

pattern), and (b) a factor judged to portray the "traditional tea.her 
which Kerlinger states "seems to be closely related to Ryans 
teacher behavior pattern (organized, systematic, ® V . 

business-like). Flanders has employed his rather complex^ interaction 
analysis" observational procedures to the study of these in i 
(stuLnt centered) and "direct" (teacher centered) behaviors and has 
developed a detailed procedure for systematizing observations. 
Rosenshine concludes that the evidence of relationships between (a) 

assessments of facets of teaching behavior ref iected in 

analysis" and (b) student achievement is not at present convincing 
but probably warrants further study. 

In some recent factor analytic studies (not yet reported in the 
literature) the writer finds major patterns of teacher characteristics 
identified •'•ii the Teacher Characteristics Study (at that time , 9 - , 

employing a different approach involving extensive 
room observation by trained observers, prior to ^P^'^ c-ralp 

Teacher Characteristics Schedule) to be supported by large 
factor analyses o£ teacher's self-report Inventory 
new factors from preliminary and partial analysis of the 9 
also appear.) The factors thus far identified in the updated (1970 71) 

Teacher Characteristics Study are: 



1. --warm, sympathizing teacher behavior 

2. --business-like, task-oriented teacher behavior 

3. --original, .motivating teacher behavior 

4. --attitude toward pupils and other persons contacted in 

schools 

3 ^ --academic focused educational viewpc/ints 
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6. --’permissive, pupil-centered educational viewpoints 

7. --verbal/semantic facility in Is/iguage in x-i/hich teaching 

is accomplished 

8. --social adjustment 

9. --commitment/dedication to teaching as a profession ^ 

10« --teaching-associated activities , i.e. , participation in 
cultural , community , and similar activities frequently 
expected of, and often attractive to, teacher. 

It is interesting to note that Turner has mentioned to the writer 
evidence that he, too, has found what seems to be a V'prof essional in- 
volvement,” or ^career motivation” pattern of teacher characteristics. 
(See No. 9 in foregoing list.) 

These studies are being extended to a number of teacher 
subcultures in the United States and plans are also underway for 
cross-national and cross -cultural s tudies in other countries. In the 
cross-cultural studies there are a number of difficult methodological 
problems to overcome, but the results may throw light on important 
problems of differences in teacher behavior that accompany differences 
in culture, as well as common patterns across different cultures. 

These may provide important aids to teacher education. Studies in 
Hawaii (of teachers of different ethnic background), have been 
completed, as has similar research on Australians from Victoria. 

Closely related to research the writer is pursuing on teacher 
characteristics in general and on their cross-cultural similarities 
and differences is somewhat similar work dealing with the ”life views” 
or value patterns of teachers who also have responded to the Teacher 
Characteristics Schedule . Unfortunately the writer *s own attempts in 
this area have not proven as meaningful as the similar large scale 
factor analyses of Teacher Characteristics Schedule responses. Admit- 
tedly this ”values” or ”life views” area is a difficult one to dissect 
and estimate. Perhaps because of the extreme uniqueness of each 
person's "values,” as well as our proneness to inconsistency of 
specific behaviors within "values” categories, the writer's data thus 
far have yielded little more than what may be an acquiescence factor 
essentially a clustering (intercorrelation) of responses representing 
a number of different value domains (at least, as those domains are 
considered from, the viewpoint of rational validity). The only 
interpretation the writer can make of the complex of values that load 
on a large general factor in these studies is that the factor may 
reflect the teacher's indoctrination during his teacher education days 
and points of view he has learned are expected of him as a member of 
the teaching profession. 
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VI. SOME RECOMMENDATIONS 

A variety of recoinmendations was made by . members of the committee. 
Many were of a very specific nature regarding methodology. Others were 
related to such topics as grade levels, locales, and similar conditions 
that might make for greater convenience, as well as better experimental 
control, in undertaking the study of teacher effectiveness. Still 
others were in terms of broad objectives, e.g., study of teacher ac- 
tivities **today** and in the near future as contrasted with an engi 
neering approach to. understanding the predictors of effectiveness that 
might be fitting with respect to teachers fifty years hence. Some 
were philosophically oriented. Almost all recommendations encompassed 
the need for systematic theory. Some were in terms of workable schoo - 
university relationships and collaborative study. Many of the recom- 
mendations were in no sense antithetical with regard to others, but 
it was difficult to fit the lot of them into a single pattern that 
could be recommended to the U. S. Office of Education for the encour 
agement of a major undertaking to encourage teacher evaluation among 
the schools. 

Several large scale programs , which may be considered as either 
alternative plans or parallel plans, are here suggested. 

One study recommended to the Office of Education is an outgrowth 
of at least two major research projects conducted by members of the 
committee. It is here recommended by the Chairman of the Committee 
and preparer of this report; it is hoped concurrence of other members 
may also support it. 

Results of the Teacher Characteristics Study led to conviction . of 
the study director (the current report writer) that behaviors of ^ 
teachers that , are judged "ef fective'V va a nimiber of conditions , 

ihcluding educational viewpoints (i .e . , values held regarding education 
by different communities) , grade levels or subject matters involved,, 
geographical area, socio-economic conditions , etc. ; and that the proper 
development of means for identifying teacher effectiveness, therefore, 
must take into account the so-called ” teacher effectiveness research 
paradigm" frequently referred to by the writer over the past 15 years. 

To accomplish the goal of the paradigm, the expectations of 
persons to whom teachers are responsible must be ascertained Y^th regard 
to their conception of characteristics contributing most significantly 
to teacher effectiveness. These , conceptions appear to vary so greatly 
from one community ;:o another that no pretense should be made at trying 
to determine any "util versals" that relate to teacher effectiveness. ^ 
This was the position taken by the Teacher Characteristics Study and y 
the current research on the Teacher Characteristics Scheduj.^ . The 
T e ach e r Ch ar a c t e r is t i cs S ch e du 1 e provides estimates of some of Ibe 
dimensions of behavioral and attitudinal responses of teachers that may 
relate to objectives sometimes adopted by teacher education programs 
and by the schools — ^objectives that persons belonging to one or another 
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group may associate with effective teaching in their own minds. If a 
teacher education program espouses objectives that place a premium 
upon **pupil“centered viewpoints,'* or "warm, sympathizing teacher be- 
havior," some of the scales provide estimates of such characteristics. 
If another teaching program places emphasis upon an '*academic“centered 
set of educational viewpoints,** upon "task-oriented teaching behavior,** 
etc., some of the scales tap these areas. 

From rather long experience, the writer has learned that although 
some educators give lip service to universal marks of teacher effec- 
tiveness, there actually is far from complete agreement among communi- 
ties, as well as among teacher education programs, regarding just what 
thi* individuals concerned want teachers to be like. As long as diverse 
opinions exist, the best we can do in determining whether a teacher 
education program (or the teacher objectives of a school) may be 
achieving what it intends to achieve, is to get the program planners to 
spell out their obj ectives as behaviorally as possible and then develop 
research designs that will provide information about the extent to 
which a specified program is nurturing teacher characteristics that 
relate to the chosen objectives. 

It should be observed, also, that other researchers share this 

view. 



Based upon a series of researches he has conducted, F. N. Kerlinger 
(30, 31), a member of this committee, urges, that in trying to determine 
what is considered effective teaching, one must recognize that 
personas opinion about good or poor teaching is ^ reflection of his 
bas ic educational orientation and' the underlying criteria operating 
to predispose his opinion must be known for effective, teaching to be 
identified. 

Similarly R. L. Turner (81, 82), another member of this committee, 
has reported notable variations in what school districts with different 
supervisory organizations expect and value with respect to primary 
compared with elementary teachers; also, that the emphasis of super- 
visory personnel on teacher "task performance** and **ability tP organize*’ 
(compared with person-oriented, permissive teacher behavior) materially 
increases as the proportion of working-class to middle-class schools in 
a school system increases . 

In view of ample research evidence, as well as a logic, supporting 
the premise that characteristics of the teacher that may be judged 
**good** by one person in one community or at one time, may not be simi’- 
larly viewed as **good** by another person, another community, or at 
another time, ^ proposed that a first maj or undertaking , preceding 
any substantive teacher effectiveness research projects directed at 
instrumentation and experimentation, should be concerned with identifi - 
cation of the major sets oj^ teacher -re la ted expectations and values 
r epresented in American education or a specified segment of American 
education, today. 
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I. Very briefly, one recommendation is that such a basic study 
might be conducted which would involve: (1) generation of a limited 

number of statements relative to school-related values or expectations 
and roles of teachers, reflecting some of the basic issues noted in 
this report and including others that may seem relevant; (2) prepara- 
tion of sets of cards, each card. bearing one of the teacher /school- 
related statements; (3) selection of a stratified random sample of 
teachers, superintendents and principals, school board members, and 
parents representing selected and identifiable geographical areas, 
kinds of communities, etc.; (4) participation of a sample of such 
respondents, each respondent performing Q-sorts (one with respect to 
elementary teachers and elementary school practices and the other with 
respect to the secondary teacher and secondary school practices; , ^ 
arranging the cards in piles representing what the responding indi- 
vidual feels to be the relative importance of each statement with 
respect to effective teaching; (5) conduct of factor analyses of the 
Q-sorts (with referent data included) to determine major patterns or 
factors; (6) identification of the factors generated with respect to 
expectations, roles, and values that define different teacher ej.fec 
tiveness emphases in different situations; (7) determination of w ic 
patterns of teacher effectiveness are associated with which kinds of 
communities, which kinds of school sett5.ngs, which kinds of persons 
(e.g., parents, teachers), etc. 



With this type of basic information it would be possible for 
different school systems to more readily identify "teaching value 
contexts" that characterize them, and to proceed through the "teacher 
effectiveness research paradigm" that the writer has frequently pro- 
posed. It also would make it possible for researchers, independent 
of the complete paradigm, to develop instruments for estimating 
behaviors related to different teacher effectiveness patterns, as wel- 
as to investigate the myriad of interrelationships of conditions and 
factors suggested in the list. of "basic issues." Still further, 
teacher education institutions undoubtedly would find the baseline 
information of substantial utility value both in planning their teacher 
education programs and also as a guide to obtaining criterion data for 
validation of teacher education efforts . 



The "teacher effectiveness research paradigm" referred to in the 
last paragraph is a rather straight-forward, step-by-step approach to 
teaching in any, or many, specified situations. The approach proba y 
has seldom been employed because of the "research" required in each 
particular school system employing it, but it is one the writer has 
long felt could do much to enlighten us in the field of education-- 
e.g. for purposes of teacher selection, placement, supervision, and 
promotion in situations where it would be possible to put applications 
of findings into practice. Above all it would provide individual _ 
guides to teacher education if its results were observed and put into 
practice. One version of the paradigm (it has differed from time to 
time only in the number of steps included) lists some 10 phases, as 
follows; 
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(1) Selection and designation of general aspects of the value 
system framework of the school/ community as those aspects 
relate to teacher behavior. The agreed-upon qualities that 
are desired, or expected, of teachers in a particular place 
and in particular kinds of teaching situations are ref erred 
to. (Note that this process of arriving at criteria neces- 
sarily is subjective and a matter of the values that indivi- 
duals or groups of individuals may possess in common. When 
we designate criteria we proceed from a context of an 
accepted value system. We view teacher behavior in light 
of a set of attitudes, opinions, and viewpoints that reflect 
the sorts of teacher behavior we approve and prefer, and 
also the kinds of behavior we disapprove and find unaccept- 
able. To the extent any group of persons share in common 
certain expectancies, preferences, or biases about teachers 
and teaching, criteria of teacher behavior may be defined 
for that particular group.) When the objectives emphasize 
(as many of us believe they should) cognitive learning, 
the criteria may include student products or student 
achievement — "low inference" criterion variables. But 
there are also numerous confounding conditions that may 
make it difficult to isolate the effects of a particular 
teacher on student performance — and we recognize these 
methodological problems as well as the "face-validity of 
student product criteria. In any event, we mi^t agree upon 
what general behaviors we expect of teachers in specified 
situations. 

( 2 ) Identification of observable properties of teacher classroom 
behavior that may be related to the specified operationally 
described criteria (i.e., the descriptive cataloguing of 

teacher characteristics and behaviors and significant 

aggregates of teacher behavior that occur in the classroom). 

(3) Identification of. kinds of situations in which the apeed- 
upon "valued teacher behaviors" may occur — and in which they 
may be observed and assessed. 

(4) Operational description (i.e., description in terms of 
actual teacher behaviors) of the agreed-upon "valued^ 
behaviors" that are to comprise the criteria of teacher 
behavior and reflect effective teaching. 

(5) Selection of methods of estimating the operationally (i.e., 
behaviorally) described "valued behaviors . " This is the 
problem of instrumentation relative to the criterion behavior 
and obtaining assessments of the criterion behaviors . ^ In 
assessing some aspect or characteristic of the criterion 
behavior of teachers we are trying to estimate the extent to 
which that defined characteristic is manifested by some teacher 
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(6) Development of instruments and procedures- that are 
hypothesized to yield estimates that will reflect the 
operationally described teacher behaviors (criterion 
behaviors) --which, in turn, are assumed to reflect the 
value framework of the school and community served . 

(7) Assembly of data yielded by the teacher assessing 
instruments and procedures noted in Step 6 above. 

(8) Assembly of data yielded by the procedures used to estimate 
the criterion behaviors --Step 5 above. 

(9) Analysis of relationships between estimates of the 
behaviorally defined criterldrr behavior and the estimates 
of teacher characteristics used in the teacher assessment 
procedure. 

(10) Finally, evaluation of teacher effectiveness by drawing of 
inferences about the validity of those procedures that were 
employed to measure teacher behavior for predicting the 
criterion behaviors designated in Steps 1 through 3 above. 

When these steps have been taken and the paradigm followed through 
to its conclusion so that knowledge of the extent to which reliable 
relationships exist between "valued behaviors" and "observable teacher 
behaviors," then the necessary groundwork has been laid for evaluation 
and in-service evaluation and teacher education evaluation can be 
accomplished objectively and successfully. 

II. A second procedure, rather closely related to the one Just 
mentioned is also highly recommended. This recoimended procedure 
admittedly has grown .from the writer 's interes t in cross-cultural 
comparisons of teachers and indeed considers different component groups 
of teachers of a single national or ethnic grouping as simply represent- 
ing subcultures. Thus secondary mathematics teachers represent a 
subculture and are not directly comparable With respect to effective 
teacher characteristics to, say, teachers of grades one and two. 
Similarly, male and female sex groups represent different subcultures. 
And certainly different communities within a large school district, 
different districts throughout a state, different sections of the 
country, and different ethnic-heritage groups represent often quite 
different subcultures of teachers. 

Drawing upon a still broader cross-cultural context the writer 
has noted the many difficulties involved in comparing teachers of 
different nations, customs, etc. In the cross -national context, he 
has observed that we may think of at least two major classes of 
variables that must be taken into account in any cross-cultural 
comparisons.:. ^ 
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(1) those variables which may be thought of as manifest or **surface*’ 
variables --simply those effects that are easily distinguished--and 

(2) those variables that may be thought of as "latent’' or "generic" 
and underlying psychological variables that influence behavior but 
which are often not readily observable. 

Within the major category of "manifest" variables, "structural 
language" variables are concerned with symbols employed, combinations 
of symbols representing objects and processes, syntax, and the like; 
these are identifiable and very clearly must be dealt with in cross- 
cultural study. (Certainly we have some of these same problems when 
we are studyins; different subcultures within the same nation.) When 
words employed in different languages have common roots the problem 
of translation, ai;d back-translation, often is not loo difficult to 
overcome. But unfortunately for cross ULLitural research many verbal 
expressions evade direct and straight -finrsfard translation from one 
language to another and are either unique to a particular language or 
perhaps set of colloquial expressions, or else vary in meaning of 
translatable forms across different gir'? :ps . Naticna.! and racial back- 
ground characteristics of social and p^jccbiological (as well as 
political, economic, religious, etc.) natore also o±-ten represent 
reasonably easily identified variables (^frequently represented to some 
degree by language forms) that might b similarly classified under the 
rubric of "surface" variables. Such VcriLables include readily recog- 
nized and operationally definable customs, traditions, mores, ideals, 
value systems , procedural practices, etc., that differ from culture to 
culture and subculture to subculture. Like language , these variables 
also pose problems for researchers who attempt to determine, common 
bases for comparing personality characteristics of different cultural 
groups. 

It should be noted that while the context from which we are 
speaking is that of cross-national and cross-racial cultures , we face 
some of the same kinds of problems among subcultures of teachers within 
a given country. And, of course, another kind of "manifest" or 
"surface" variable is represented by subcultures, per se , and their 
attributes (e.g., in the case of teachers as members of an occupational 
subculture, still more specific distinguishable subcultures identified 
through a.ge , experience, level of instruction, subject matter taught, 
sex, geographic area within a particular nation or culture, etc.). 

In comparing major cultures, these subcultural variables are important 
concerns both because of their s ignif icance as separate variables 
worthy of consideration as dependent variables and also as conditions 
or independent variables that must be taken into account in sampling 
for the comparison of major cultures of which they are components. 

The second major grouping referred to was the "latent" variables 
or "generic" variables. These are less readily recognized variables , 
often insidious, yet representing extrejpely potent effects and sources 
of variation, and presenting particularly difficult problems for 
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research. Here the variables involve relativity of meanings, mores , ^ 
values, etc., in different cultural and subcultural contexts. In this 
category could be included semantic variables, a sizeable array of 
characteristics that relate to. the representativeness of the respondent 
or experimental subject as an individual typifying his subcultural 
group in comparisons made with members of other subcultural groups , 
and the like. Contaminating biases of this nature are difficult to 
determine and equate. Inevitably it seems cross-cultural personality 
research also is faced with respondent biases relating to "rreservation 
or "caution" in verbal response arid/or overt behavior (as contrasted 
with "openness" and "frankness") when comparisons with other groups 
are known to be involved, with respondent concern about what he per- 
ceives as invasion of the researcher upon personal behavior of the 
individual, and with other respondent biases that may invalidate re- 
sponses or lead to nonresponse. In a somewhat similar context are 
"researcher" or investigator biases that may confound cross-cultural 
studies. Variables of this sort involve the quality and extent of 
participation on the part of collaborating investigators in different 
subcultures or cultures; sometimes because of attitudes toward 
practices involved in the role of investigator in a particular su - ^ 
culture or because of lack of assurance on the part .of a collaborating 
investigator that he really "belongs to the team" and actually shares 
in participation in decisions and credits, or because of other similar 
conditions that bear upon maintenance of comparable conditions of data 
ga^thering in the subcultures being compared. 



Thus far, reference has been made Only to some of the more 

readily discernible variables that cross-cultural research must take 

into account and nothing has been said of methodology for attempting 
to equate, balance out, partial out , or otherwise control relevant 
variables in order to make possible the study of similarities and 
differences in personality dimensions across subcultures. Such 
methodology poses a major stumbling block. Applicable designs are 
difficult to conceive and if a viable rationale is formulated it is 
often difficult and costly in time and resources to achieve. 



In cross-cultural research one seldom can start with any advance 
information of similarity of content; indeed there is recognition 
that similar appearing content may have dissimilar meanings^in 
different subcultures and dissimilar appearing content may have 
similar meanings. The pollsters and market researchers are keenly 
aware of this. Attempts to define and designate criteria for deter- 
mining responses that contribute to a particular domain across 
populations differing in expressions of "surface" and latent vari- 
ables represent another example, of this dilemma. And, how does one 
determine what behavior a response reflects, or how valid a single 
response or set of responses comprising a **score" may be in one or 
another culture or subculture? The crux of the question of cross-_ 
cultural equivalence or comparability seems to rest on the assumptions 
that can be made and procedures that can be employed relating to the 
concept of validity. 
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The difficulties involved in determining behavior and/or response 
equivalence across subcultures seems almost impossible to resoI:ve; and 
these difficulties are multiplied for the behavioral scientist oy the 
fact he is dealing vith psychological constructs vhich seldom are 
invariant (\tfith regard to meanings attached to a particular construct, 
e.g., pers-' stance) vithin a given subculture. And, construct invari- 
ance necessarily increases as one moves from one subculture to 
another. 

if there be procedures that are applicable to the determination 
of the personality patterns that are discernible across different 
cultures and the validity of response content in reflecting personality 
dimensions in differing cultures, they would seem to be those cz the 
form of "construct validation" s 9 metim.es referred to as "intrinsic 
validation:" or "factorial validation," i.e., validity determi^^i tion by 
correlational and factor analyses. Here we attempt to establosh mean- 
ings from contexts in which r^ponses occur — a very necessary procedure 
for the understanding of psychcslogical constructs and for detarmiining 
the approximate equivalency of constructs and the equivalency xf 
response content that reflects the ccnstructs across cultures. In 
general, then, the procedures that may be used in studying the differ- 
ent subcultures of teachers in the United States involve large scale 
factor analyses applied to (a) judgments and (b) self-report inventory 
responses relating to preferred activities, typical behaviors, opinions, 
and the like. 

The second approach, therefore, that the writer is recommending 
as one that schools in the United States could well apply to the study 
of teacher effectiveness and the invariance, or lack of universality 
of meaning, of teacher effectiveness in one community as compared to 
another is essentially one of approaching each of a representative 
sample of communities as a subculture. The recommendation with this 
respect is that the program of research to be followed? would be such 
as that noted below, with the phases as indicated: 

(1) Determination in each community or subculture of those teacher 
characteristics that are generally valued in teachers in a particular 
subculture. This would be essentially, a "judgmental" process, perhaps 
employing a "critical incident approach" (or possibly using a gener- 
alized "Q-sort" procedure, or some form of latent partition 
analysis--or possibly two or more such approaches in combination); 

(2) Development in each community or subculture of operational 
definitions of those teacher characteristics that seemed most 
significant in the light of phase one; 

(3) Development in each subculture or community of inventory 
type (self-report) items that could be hypothesized to estimate the 
major patterns of teacher characteristics revealed in phases 1 and 2 ; 
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(4) Incorporation of items from each subculture or community 
into a single inventory or **schedule" that cou-^d be administered in 
all subc^^„ures or communities involved; 

(5) Translation of the single overall inventory, insofar as 
possible, including different dialects and colloquialisms as \-eil as 
common language structure (perhaps placing directly translatable items 
together and placing those items that were not universally translatable 
together in a subsection) ; 

(6) Administration of the inventory to representative samples 
of teachers in each subculture or community: 

(7) Factor analyses of the responses for ^a) polled data for all 
participating subcultures or communities and (b) data f?rom each 
separate subculture or community separately; 

(8) **Factor matching'* to determine (a) unique and (b) imuon 
factors ; 



(9) For common factors (a) development of a suitable prcredure 
(and this introduces a most difficult problem) that might yield indices 
of ’’response, equivalence" for differing responses that contribute to 
apparently similar factors in different subcultures or communities, and 
(b) development of suitable procedures (again, a most difficult prob- 
lem) for determining norms comparability from one subculture or 
community to another with respect to common-appearing factors. 

The writer, and the committee charged with the responsibility, 
respectfully submit this report to the U. S. Office of Education and 
urge serious consideration of the recommendations for study of the 
problem of teacher effectiveness, looking towards iTiajor study follow- 
ing one of the sets of recommendations suggested--a study that might 
provide answers to problems that, in the past, have appeared insoluble. 
It is firmly believed by the committee that the empirical study of 
teacher effectiveness is possible, that teacher effectiveness can be 
assessed, and that methods of analyses are ava5.1able for making 
possible instruments that could prov?lde assessments of teacher 
behavior which would conform to the qualities desired by a particular 
community or school. The relativity of "teacher effectiveness" is 
thus recognized, but procedures are suggested that might make possible 
the encouragement of the evaluation of teacher effectiveness without 
demanding that all schools and communities subscribe to a common set 
of values. 
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